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FUNCTIONS 

I 


•I  dentify  and  eliminate  safety 
issues  &  cost  drivers  associated 
with  operating  aging  aircraft 

•Provide  PMA's  with  timely 
recommendations  for 
engineering,  logistics  solutions, 
cost  analysis,  and  coordination 
with  other  Services  ( DoD,  FAA, 
NASA) 

•Facilitate  implementation  of 
new  technology  solution 


Background 


fc.r 


LRL  concept  evolved  from  the  DOD  5000.2  mandated 
Technology  Readiness  Levels  (TRL)  assessment 
process 

-  TRLs  provide: 

•  Evaluation  of  critical  technology  maturity 

•  Maturation  plan  (as  needed) 

•  Best  practices/ guidelines  for  each  Milestone 

-  MS  B  target  is  TRL  =  6 

-  MS  C  target  is  TRL  =  7 

-  MS  C  preferred  is  TRL  =  8 

-  Understanding  of  the  technical  maturity  without  consideration 
of  the  sustainment  of  those  technologies 

•  TRLs  were  never  intended  to  consider  logistics 


LRL  is  a  new  concept  intended  to  consider 

sustainment  issues 


Background 


•  Logistics  benchmark  system  was  desirable 

-  —10  logistics  elements  that  are  often  interdependent 
and  parallel  are  required  to  successfully  acquire,  field, 
and  support  new  technology 

-  Aid  in  understanding  what  sustainment  is  required  at 
different  time  phases 


Engineers  and  Logisticians  need  clear  definition 
of  what  is  required  for  sustainment  at  each 

phase  of  a  project 


LRL  Definition 


fc.r 


•  LRL  intent: 


-  Provide  a  methodology  for  assessing  Logistic 
Element  Readiness  for  technology 

-  Establish  benchmarks  for  programs  at  different 
phases  in  time 

-  Provide  a  management  tool  to  forecast  logistics 
workload,  manpower  requirements,  identify  gaps, 
etc. 


•  NAVAI R  Aging  Aircraft  convened  a  working  group  of 
engineers,  logisticians,  and  program  managers  to  draft 
an  LRL  concept 

-  LRL  concept  is  work  in  progress 

-  I  nitial  phase  focus  was  on  technology  insertion  for 
in-service  (post  MS  C)  aircraft  platforms 


LRL  Definition 


fc.r 


•  LRL's  evaluated  for  6  project  phases: 
-  Lab  Testy  R&D 


-  Project  Definition  (Fleet  Need/ metrics/ BCA/ Decision  to 
proceed) 

-  Project  Development /I  mplementation  (Finalized 
analysis,  change  recommended,  ECP  development, 
Class  1 1  change  development,  RAMEC,  LECP,  other) 

-  Engineering  Validation 

-  Fleet  Verification 


-  Fleet  Use 


•  First  step  is  to  discern  what  phase  your  tech 
insertion  project  is  in 


LRL  Definition 


•  Evaluation  Criteria  gathered  from  numerous  sources 
including  but  not  limited  to: 

-  Defense  Acquisition  Guidebook 

-  OSD  Designing  and  Assessing  Supportability  in  DOD  Weapon 
Systems:  A  Guide  to  I  ncreased  Reliability  and  Reduced 
Logistics  Footprint 

-  DON  I  ndependent  Logistics  Assessment  Handbook 

-  Defense  Acquisition  University  logistics  curriculum 

-  NAVAI R  Acquisition  Logistics  Support  Plan  Guide 

-  NAVAI  R  Deputy  Assistant  Program  Manager  for  Logistics 
(DAPML)  Handbook 

-  ASN  RD&A  Acquisition  Logistics  for  the  Rest  of  Us 


LRL  Definition 


•  Evaluation  criteria  established  for  each  phase  in  a 
Microsoft  Excel  worksheet  format 


-  Determined  what  is  the  benchmark  of  required  tasks 
appropriate  for  each  logistics  element  at  that  time  phase 

-  Not  all  elements  require  same  level  or  effort  in  the  same 
time  phase 

•  Answers  question  of  "What  tasks  must  be  complete 
at  each  project  phase  for  each  logistics  element?" 


URL  Evaluation  Criteria  -  Excerpt  for 

Design  I  nterface 


Phase 

Lab  Test / 
R&D  phase 

Project 

Definition 

Project 

Development/ 

Implementation 

Engineering 

Validation 

Fleet 

Verification 

Fleet  Use 

Review  and 

Existing 

For  new  designs, 

Results  of  RCM 

Technical 

Technical 

identify 

Reliability  and 

Reliability 

and  FMEA 

updates 

updates 

significant 

Maintainability 

Centered 

used  to  develop 

(such  as 

completed 

design 

(RAM)  metrics 

Maintenance 

or  modify 

Maintenance 

and 

interface 

reviewed.  Initial 

(RCM)  and  Failure 

existing 

Requirement 

available. 

impacts  of 

improvement 

Modes  and 

condition  based 

Card 

project  to 

predictions 

Effects  Analysis 

and  schedule 

changes) 

existing 

determined. 

(FMEA) 

based 

verified. 

system  or 

Design 

completed  to 

maintenance 

Design 

Interface 

platform  (eg. 

interface  issue 

identify  failure 

tasks.  Results 

available 

resolution  in 

modes,  failure 

of  RCM  and 

power,  weight 

work. 

frequency,  effect 

FMEA  also 

constraints, 

on  performance, 

used  to  update 

etc.)  Create 

and  criticality.  For 

the  Critical 

POAM  to 

modifications  to 

Items  list  as 

resolve  any 

existing  design, 

applicable. 

design 

RCM  and  FMECA 

Technical  data 

interface 

reviewed  for 

updates  drafted 

issues. 

impacts.  Design 
interface  issues 
resolved. 

and  validated. 

URL  Evaluation  Criteria  -  Excerpt  for 

Training  &  Facilities 


Phase 

Lab 

Test/ 

R&D 

phase 

Project 

Definition 

Project 

Development/ 

Implementation 

Engineering 

Validation 

Fleet 

Verification 

Fleet  Use 

Training 

Existing 

training 
procedures/ 
curricula  and 
training  plan 

identified  and 
reviewed. 

Impacts  to  Training 
identified 

Training 

curricula 

changes  drafted. 
As  required 
changes  to 

Naval  Training 
Systems  Plan 
(NTSP)  drafted. 

Training  curricula 

changes  updated 
post 

validation/verificati 
on  with  changes  as 
necessary.  NTSP 
changes  finalized. 
Changes  submitted 
for  approval. 

Training 

curricula 

updated. 

NTSP 

updated. 

Facilities 

Current  Facilities 
reviewed  and  impacts 
identified.  When 
applicable,  facilities 
modifications  or  new 
requirements  are 
documented  and 
analysis  completed  for 
(in)  adequacy  of 
existing  facilities,  trade 
studies  for  optimal  new 
facility,  funding 
requested. 

As  needed  with 

funding 

available, 

Facilities 
modifications  or 
new  facilities 
projects  in  work. 

Facilities  project 
completed  and 
approved. 

New  or 
modified 
Facilities 
completed  . 

LRL  Evaluation  Criteria  -  Excerpt  for 

DMSMS 


Phase 

Lab 
Test  / 
R&D 
phase 

Project 

Definition 

Project 

Development/ 

Implementation 

Engineering 

Validation 

Fleet 

Verification 

Fleet  Use 

DMSMS 

Existing  DMSMS 
program 
management 
plan  reviewed. 
Determine  the 
technical 
refresh  strategy 
(2  yr,  4  yr,  spiral, 
etc.) 

New  technology 
evaluated  to 
determine 
criticality  as  it 
relates  to 

DMSMS.  Assess 
components 
against  the  tech 
refresh  strategy. 
Impacts  to 

DMSMS  plan  or 

metrics 

identified. 

DMSMS 

forecasting 

completed  for 
new  technology. 
Updates  to 
DMSMS 
management 
plan  drafted. 
Technical  data 
package 
requirements 
drafted. 

DMSMS 
management 
plan  updated. 
Technical  data 
package  that 
supports 

DMSMS 

mitigation 

strategy 

available. 

Metrics 

and  usage 
monitored 
as  required. 

LRL  Quantified 


•  With  benchmarks  established,  focused  on  quantifying 
effort  required  to  achieve  those  benchmarks 

-  Useful  for  project  planning  of  available  personnel  and  resources 

•  Evaluated  percentage  of  total  effort  required  at  each 
phase 

-  Considered  each  logistics  element  to  have  a  100%  total  effort  by 
last  phase 

•  Simply  stated  each  logistics  element  is  fully  supported  by  "Fleet  Use" 

•  Percent  effort  is  subjective  number  based  on  efforts 
outlined  in  the  LRL  for  each  element  at  each  phase 

•  Graphed  percentage  effort  as  a  function  of  phase  of  the 
project 

•  Example  of  one  way  to  depict  data 


Percent  Effort  by  Project  Phase 


Lab  Test/R&D  Phase  Project  Definition  Project  Development  Engineering  Validation  Fleet  Verification  Fleet  Use 

Project  Phase 


LRL  Tool 
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•  LRL  tool  created  in  Microsoft  Excel  (compatible  with 
Microsoft  Office  2003)  to  evaluate  a  logistics  readiness 
level 

•  Detailed  evaluation  requires  familiarity  with  the  project 
and  tasks  completed  to  date 

•  Buttons  allow  a  point  and  click  use  of  color 

-  Grey  indicates  the  project  is  not  yet  in  that  project  phase 
therefore  benchmarks  are  not  applicable 

-  Blue  indicates  the  benchmark  is  not  applicable  due  to  the  details 
of  the  project 

-  Red  indicates  the  benchmark  task  is  not  complete 

-  Green  indicates  the  benchmark  task  is  complete 


LRL  Tool 


•  Numeric  LRL  score  evaluated  for  each  project  phase 

-  LRL  =  0  Unsupported  (zero%  required  tasks  completed) 

-  LRL  =  1  Poorly  Supported  (1-50%  of  required  tasks  completed) 

-  LRL  =  2  Moderately  Supported  (50-70%  or  required  tasks 
completed) 

-  LRL  =  3  Nearly  Supported  (70-90%  of  required  tasks 
completed) 

-  LRL  =  4  Fully  Supported  (100%  of  required  tasks  completed) 

•  Numeric  LRL  scale  provides  a  reference  framework  for 
project  comparison 


An  [LRL  of  4  is  the  goal  for  all  phases 


LRL  Prototypes 


fc.r 


•  Completed  4  prototypes  on  current  Air  Vehicle  Projects 

-  Identified  gaps  in  logistics  support  (red  areas) 

-  Gaps  reviewed  with  team  leads  and  plan  of  action  created 

-  Plan  to  complete  updated  evaluation  no  later  than  six  weeks 

-  Monitor  progress  from  initial  evaluation  and  follow  on  evaluations 

•  Demonstration  to  follow  in  Microsoft  Excel 


LRL  Benefits 

•  Benefits  of  LRLs  include: 

-  Template/ benchmark  to  measure  readiness  by  logistic 
element  on  a  project  level  basis 

•  Utilized  to  train/mentor  new  logisticians,  engineering  and 
program  management  personnel  in  sustainment  requirements  for 
tech  insertion  projects 

-  Aid  in  planning  manpower/funding/schedule 
requirements  for  projects  as  they  mature  from  project 
concept  to  implementation 

-  Dovetail  with  logistics  risk  assessments  for  another 
perspective 

-  Offers  a  logistics  readiness  perspective  for  technology 
insertion  currently  missing  fromTRL  evaluations 

Value  of  LRL  is  the  establishing  the 
time  phase  benchmarks 


Next  Steps 


•  Continue  to  collect  input  on  Draft  LRL  concept 

-  Update/change  draft  as  needed 

•  Establish  a  J  oint  working  group  to  expand  the  scope  to 
encompass  a  more  joint  perspective 

•  Complete  four  prototypes  with  follow  up  evaluations 

•  I  nitiate  LRL  evaluation  for  all  Air  4.  ID  Air  Vehicle  Projects  in 
FY  07 


Questions? 


AAI PT  Points  of  Contact 


fc.r 


•  AAI  PT  Lead,  Bob  Ernst,  301-342-2203, 
robert .  ernst@navy.  mi  I 

•  AAI  PT  J  acksonville  Wiring,  Andrew  Yang,  904-594-5821, 
andrew.yang@navy.  mil 

•  AAI  PT  Assistant  Program  Manager  for  Logistics,  Harry 
Proffitt,  301-757-0868,  melvin.proffitt@navy.mil 

•  AAI  PT  Air  Vehicle  I  PT  lead,  Don  Sheehan,  301-342-9738, 
donald .  sheehan@navy .  mi  I 

•  AAIPT  Consultant,  Elizabeth  Broadus,  301-862-7049, 
broadus_elizabeth@bah.com 


